OpenStack Pike : How to use Manila#1
2017/09/18 |
This is How to use OpenStack Shared File System (Manila).
This example is based on the emvironment like follows.
For example, Configure local block device as shared storage on Storage Node and use it from Instances.
Therefore, it needs there is a free block device on Storage Node.
------------+---------------------------+---------------------------+------------ | | | eth0|10.0.0.30 eth0|10.0.0.50 eth0|10.0.0.51 +-----------+-----------+ +-----------+-----------+ +-----------+-----------+ | [ Control Node ] | | [ Storage Node ] | | [ Compute Node ] | | | | | | | | MariaDB RabbitMQ | | | | Libvirt | | Memcached httpd | | L2 Agent | | Nova Compute | | Keystone Glance | | L3 Agent | | L2 Agent | | Nova API | | Metadata Agent | | | | Neutron Server | | Manila Share | | | | Metadata Agent | | | | | | Manila API | | | | | +-----------------------+ +-----------------------+ +-----------------------+ |
[1] | Configure Storage Node. |
root@storage:~#
apt-get -y install lvm2 nfs-kernel-server # create a volume for Manila on free block device root@storage:~# pvcreate /dev/sdb1 Physical volume "/dev/sdb1" successfully created root@storage:~# vgcreate manila-volumes /dev/sdb1 Volume group "manila-volumes" successfully created
root@storage:~#
vi /etc/manila/manila.conf # add follows into [DEFAULT] section
enabled_share_backends = lvm
# add to the end [lvm] share_backend_name = LVM share_driver = manila.share.drivers.lvm.LVMShareDriver driver_handles_share_servers = False lvm_share_volume_group = manila-volumes lvm_share_export_ip = 10.0.0.50 systemctl restart manila-share nfs-server root@storage:~# systemctl enable manila-share nfs-server
|
[2] | Create default share type. It's OK to work on any node. (This example is on Control Node) |
root@dlp ~(keystone)# manila type-create default_share_type False +----------------------+--------------------------------------+ | Property | Value | +----------------------+--------------------------------------+ | required_extra_specs | driver_handles_share_servers : False | | Name | default_share_type | | Visibility | public | | is_default | - | | ID | 9498959f-e08c-40de-94c6-271cfbd94b39 | | optional_extra_specs | | +----------------------+--------------------------------------+root@dlp ~(keystone)# manila type-list +-----------+--------------------+------------+------------+--------------------------------------+-------+ | ID | Name | visibility | is_default | required_extra_specs | opt.. | +-----------+--------------------+------------+------------+--------------------------------------+-------+ | 9498959f- | default_share_type | public | YES | driver_handles_share_servers : False | | +-----------+--------------------+------------+------------+--------------------------------------+-------+ |
[3] | Create NFS share. |
root@dlp ~(keystone)# manila create NFS 10 --name share01 +---------------------------------------+--------------------------------------+ | Property | Value | +---------------------------------------+--------------------------------------+ | status | creating | | share_type_name | default_share_type | | description | None | | availability_zone | None | | share_network_id | None | | share_server_id | None | | share_group_id | None | | host | | | revert_to_snapshot_support | False | | access_rules_status | active | | snapshot_id | None | | create_share_from_snapshot_support | False | | is_public | False | | task_state | None | | snapshot_support | False | | id | 376e25d6-521a-4745-88d7-ba5012870762 | | size | 10 | | source_share_group_snapshot_member_id | None | | user_id | 71b407652ab4433a801915ab21018ffd | | name | share01 | | share_type | 9498959f-e08c-40de-94c6-271cfbd94b39 | | has_replicas | False | | replication_type | None | | created_at | 2017-09-20T07:42:48.000000 | | share_proto | NFS | | mount_snapshot_support | False | | project_id | 1ca37b956ae4451892dfcc47f5f98913 | | metadata | {} | +---------------------------------------+--------------------------------------+ # few minutes later, the Status turns to available root@dlp ~(keystone)# manila list +-----------+---------+------+-------------+-----------+-----------+--------------------+---------+--------+ | ID | Name | Size | Share Proto | Status | Is Public | Share Type Name | Host | Avai.. | +-----------+---------+------+-------------+-----------+-----------+--------------------+---------+--------+ | 376e25d6- | share01 | 10 | NFS | available | False | default_share_type | netw... | nova | +-----------+---------+------+-------------+-----------+-----------+--------------------+---------+--------+ |
[4] | It's OK all, you can use Manila Shared filesystem from Instances like follows. |
root@dlp ~(keystone)# openstack server list +-----------+-------------+---------+------------------------------------+------------+----------+ | ID | Name | Status | Networks | Image | Flavor | +-----------+-------------+---------+------------------------------------+------------+----------+ | f5ae3046- | Ubuntu_1604 | SHUTOFF | int_net=192.168.100.10, 10.0.0.210 | Ubuntu1604 | m1.small | +-----------+-------------+---------+------------------------------------+------------+----------+ # allow access permission first root@dlp ~(keystone)# manila access-allow share01 ip 192.168.100.0/24 --access-level rw +--------------+--------------------------------------+ | Property | Value | +--------------+--------------------------------------+ | access_key | None | | share_id | 376e25d6-521a-4745-88d7-ba5012870762 | | created_at | 2017-09-20T07:44:56.000000 | | updated_at | None | | access_type | ip | | access_to | 192.168.100.0/24 | | access_level | rw | | state | queued_to_apply | | id | 297708f9-36ee-43cb-8c4b-e012607fcb52 | +--------------+--------------------------------------+ # it's no ploblem if State turns to active root@dlp ~(keystone)# manila access-list share01 +-----------+-------------+------------------+--------------+--------+------------+---------------+---------+ | id | access_type | access_to | access_level | state | access_key | created_at | updat.. | +-----------+-------------+------------------+--------------+--------+------------+---------------+---------+ | 297708f9- | ip | 192.168.100.0/24 | rw | active | None | 2017-09-20... | None | +-----------+-------------+------------------+--------------+--------+------------+---------------+---------+
root@dlp ~(keystone)#
openstack server start Ubuntu_1604 # confirm access Path root@dlp ~(keystone)# manila show share01 | grep path | cut -d'|' -f3 path = 10.0.0.50:/var/lib/manila/mnt/share-ebb667fd-f81a-45a0-8e35-a7776c777601
root@dlp ~(keystone)#
ssh ubuntu@10.0.0.210 Welcome to Ubuntu 16.04.3 LTS (GNU/Linux 4.4.0-93-generic x86_64) # mount Manila shared storage ubuntu@ubuntu-1604:~$ sudo mount -t nfs 10.0.0.50:/var/lib/manila/mnt/share-ebb667fd-f81a-45a0-8e35-a7776c777601 /mnt ubuntu@ubuntu-1604:~$ df -hT Filesystem Type Size Used Avail Use% Mounted on udev devtmpfs 982M 0 982M 0% /dev tmpfs tmpfs 201M 3.1M 197M 2% /run /dev/mapper/ubuntu--vg-root ext4 7.3G 1.3G 5.7G 18% / tmpfs tmpfs 1001M 0 1001M 0% /dev/shm tmpfs tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs tmpfs 1001M 0 1001M 0% /sys/fs/cgroup /dev/vda1 ext2 472M 55M 393M 13% /boot tmpfs tmpfs 201M 0 201M 0% /run/user/1000 10.0.0.50:/var/lib/manila/mnt/share-ebb667fd-... nfs4 9.8G 23M 9.2G 1% /mnt |